Wearable apparatus and information processing method and device thereof

ABSTRACT

A wearable apparatus, including: an image collector ( 11 ), configured to acquire facial images and body images of an interaction partner who is interacting with the user of the apparatus; a controller ( 12 ) connected with the image collector and configured to analyze the facial images and the body images to achieve analysis results; and an output device ( 13 ) connected with the controller and configured to output the analysis results. The wearable apparatus is portable and of low cost, and capable of determining the psychological situation of the current interaction partner according to the images information of the interaction partner based on simple operations. An information processing method and an information processing apparatus of the wearable apparatus are also provided.

TECHNICAL FIELD

The present disclosure relates to a wearable apparatus as well as aninformation processing method and an information processing device for awearable apparatus.

BACKGROUND

With the development of internet technologies, a growing number ofintelligent wearable apparatuses have come into our life. Intelligentwearable apparatuses can bring great convenience to their users' lives.For example, intelligent glasses can be used by their users to takepictures of scenes sawn by them and share the pictures through networks.

Nowadays, communications between two parties in society are often mixedwith a lot of falsehood/lies and a lie detector can be used to determinewhether what someone has said is true. For example, while the contactsof a lie detector are coupled to the body of the subject to be detected,the subject is asked questions and then the variation of his brain waveor heart rate is observed to determine comprehensively his index of lie.

However, the test using the above-mentioned lie detector has to berepeated; besides the lie detector must be coupled to the body of thesubject, and is complex to operate, of high costs and inconvenient tocarry. Therefore, how the inner truth of a communicate (e.g. thetruthfulness of what he has said) can be monitored using a simple andportable intelligent wearable apparatus has become a problem to besolved urgently.

SUMMARY

According to one aspect of this disclosure, a wearable apparatus isprovided, comprising: an image collector configured to acquire facialimages and body images of an interaction partner who is interacting withthe user of the apparatus; a controller connected with the imagecollector and configured to analyze the facial images and the bodyimages to achieve analysis results; and an output device connected withthe controller and configured to output the analysis results.

For example, wherein the image collector is a first camera to acquirefacial images and body images of the interaction partner; or the imagecollector comprises a second camera to acquire body images of theinteraction partner and a receiver to receive facial images of theinteraction partner.

For example, wherein the first camera and/or the second camera are/isbinocular camera(s).

For example, wherein the output device is a display screen for displayof analysis results; or the output device is a voice displayer forplayback of analysis results in voice.

For example, wherein the wearable apparatus is intelligent glasses.

For example, wherein the intelligent glasses further comprise a glassesbody and the image collector, controller and output device are alldisposed on the glasses body.

For example, wherein the analysis results comprise an analysis result ofbehavior obtained through analyzing the body images as well as ananalysis result of heart rate and an analysis result of pupil obtainedby analyzing the facial images.

For example, wherein the wearable apparatus further comprises aselecting device, which is connected with the controller and configuredto receive a selecting instruction from the user and send it to thecontroller so that the controller may obtain analysis resultscorresponding to the selecting instruction.

For example, wherein the selecting device comprises a first selectingunit to receive an analysis instruction for interest from the user and asecond selecting unit to receive an analysis instruction for credibilityfrom the user.

For example, wherein the wearable apparatus further comprises: awireless module connected with the controller and operable tocommunicate with network equipments through a wireless network; and/or aGPS module connected with the controller and operable to locate thewearable apparatus; and/or an image collector connected with thecontroller and operable to acquire facial images of the user of thewearable apparatus and a transmitter connected with the controller andoperable to transmit the images acquired by the image collector.

For example, wherein the wearable apparatus comprises a head-mountedwearable apparatus.

For example, wherein the interaction partner comprises a conversationpartner.

According to one aspect of this disclosure, An information processingmethod for a wearable apparatus is provided, comprising: acquiring imageinformation of the interaction partner who is interacting with the userof the wearable apparatus, the information comprising facial images andbody images of the interaction partner; analyzing the body images toachieve an analysis result of behavior and analyzing the facial imagesto achieve an analysis result of heart rate and an analysis result ofpupil; determining an output result of the conversation contents givenby the interaction partner in accordance with the analysis result ofbehavior, analysis result of heart rate and analysis result of pupil;and outputting the output result of the conversation contents to theuser of the wearable apparatus.

For example, before the body images are analyzed, the method furthercomprises the step of receiving a selecting instruction; if the receivedselecting instruction is an analysis instruction for interest, theanalysis results of behavior, heart rate and pupil are respectivelyanalysis results of behavior, heart rate and pupil indicating whetherthere is interest in the interaction contents; and if the receivedselecting instruction is an analysis instruction for credibility, theanalysis results of behavior, heart rate and pupil are respectivelyanalysis results of behavior, heart rate and pupil indicating thecredibility rate of the interaction contents.

For example, wherein the step of analyzing the body images to achieve ananalysis result of behavior comprises: comparing the body image at thecurrent point in time with the body image at the first point in time;and determining an analysis result of behavior indicating that theconversation partner is interested in the current interaction contentsif the body image at the current point in time is nearer to the userrelative to the body image at the first point in time; wherein the firstpoint in time is prior to the current point in time, and there is apreset interval between the two points.

For example, wherein the step of analyzing the facial images to achieveanalysis results of heart rate and pupil comprises: analyzing the facialimages using contactless pulse oximetry to achieve the analysis resultof heart rate; obtaining the pupil area in the facial image at thecurrent point in time and the pupil area in the facial image at thesecond point in time; and comparing the pupil area at the current pointin time with the pupil area at the second point in time to achieve theanalysis result of pupil; wherein the second point in time is prior tothe current point in time, and there is a preset interval between thetwo points.

For example, wherein the step of determining an output result of theinteraction contents given by the interaction partner in accordance withthe analysis result of behavior, analysis result of heart rate andanalysis result of pupil comprises: determining the output result of theinteraction contents of the interaction partner to be positive when atleast two of the analysis result of behavior, analysis result of heartrate and analysis result of pupil are positive; or in accordance withpredetermined weighting factors of individual analysis results,obtaining the output result of the interaction contents of theinteraction partner by multiplying the analysis results with their ownweighting factors and adding the products together; or obtaining theaverage value of all the analysis results and taking it as the outputresult of the interaction contents of the interaction partner.

For example, wherein the wearable apparatus comprises a head-mountedwearable apparatus.

For example, wherein the interaction partner comprises a conversationpartner.

According to one aspect of this disclosure, an information processingdevice for a wearable apparatus is provided, the device comprising: anacquiring unit configured to acquire image information of theinteraction partner who is interacting with the user of the wearableapparatus, the information comprising facial images and body images ofthe interaction partner; a processing unit configured to analyze thebody images to achieve an analysis result of behavior and analyze thefacial images to achieve analysis results of heart rate and pupil; ananalyzing unit configured to determine an output result of theinteraction contents given by the interaction partner in accordance withthe analysis result of behavior, analysis result of heart rate andanalysis result of pupil; and an output unit configured to output theoutput result of the interaction contents to the user of the wearableapparatus.

For example, wherein the device further comprises: a receiving unitoperable to receive an selecting instruction from the user before thebody images and the facial images are analyzed by the processing unit;wherein if the received selecting instruction is an analysis instructionfor interest, the analysis results of behavior, heart rate and pupilfrom the processing unit are respectively analysis results of behavior,heart rate and pupil indicating whether there is interest in theinteraction contents; and if the received selecting instruction is ananalysis instruction for credibility, the analysis results of behavior,heart rate and pupil from the processing unit are respectively analysisresults of behavior, heart rate and pupil indicating credibility rate ofthe interaction contents.

For example, wherein the processing unit is further configured tocompare he body image at the current point in time with the body imageat the first point in time; and determine an analysis result of behaviorindicating that the conversation partner is interested in the currentinteraction contents if the body image at the current point in time isnearer to the user relative to the body image at the first point intime; wherein the first point in time is prior to the current point intime, and there is a preset interval between the two points.

For example, wherein the processing unit is further configured toanalyze the facial images using contactless pulse oximetry to achieve ananalysis result of heart rate; obtain the pupil area in the facial imageat the current point in time and the pupil area in the facial image at asecond point in time; and compare the pupil area at the current point intime with the pupil area at the second point in time to achieve ananalysis result of pupil; wherein the second point in time is prior tothe current point in time, and there is a preset interval between thetwo points.

For example, wherein the analyzing unit is further configured todetermine the output result of the interaction contents of theinteraction partner to be positive when at least two of the analysisresults of behavior, heart rate and pupil are positive; or in accordancewith predetermined weighting factors of individual analysis results,obtain an output result of the interaction contents of the interactionpartner by multiplying the analysis results with their own weightingfactors and adding the products together; or obtain the average value ofall the analysis results and taking it as the output result of theinteraction contents of the interaction partner.

For example, wherein the wearable apparatus comprises a head-mountedwearable apparatus.

For example, wherein the interaction partner comprises a conversationpartner.

BRIEF DESCRIPTION OF DRAWINGS

FIGS. 1a-1b are structure diagrams of a head-mounted wearable apparatusprovided in an embodiment of the present disclosure;

FIG. 2 is a structure diagram of a head-mounted wearable apparatusprovided in another embodiment of the present disclosure;

FIG. 3 is a flowchart of an information processing method for ahead-mounted wearable apparatus provided in an embodiment of the presentdisclosure;

FIG. 4 is a flowchart of an information processing method for ahead-mounted wearable apparatus provided in another embodiment of thepresent disclosure;

FIG. 5 are pictures of a scene for a head-mounted wearable apparatusprovided in an embodiment of present disclosure;

FIG. 6 is a schematic diagram of an analysis area in a facial imageprovided in an embodiment of present disclosure; and

FIG. 7 is a structure diagram of an information processing device for ahead-mounted wearable apparatus provided in an embodiment of presentdisclosure.

DETAILED DESCRIPTION

The technical solutions of the embodiments will be described in aclearly and fully understandable way in connection with the drawingsrelated to the embodiments of the disclosure. Apparently, the describedembodiments are just a part but not all of the embodiments of thedisclosure. Based on the described embodiments herein, those skilled inthe art can obtain other embodiment(s), without any inventive work,which should be within the scope of the disclosure.

FIGS. 1a-1b show structural diagrams of a head-mounted wearableapparatus provided in an embodiment of the present disclosure. As shownin FIG. 1 a, the head-mounted wearable apparatus in the presentembodiment includes an image collector 11, a controller 12 connectedwith the image collector 11 and an output device 13 connected with thecontroller 12. For example, the image collector 11 may be a camera, thecontroller 12 may be a central processing unit, a microprocessor chip,etc., and the output device 13 may be a display, a speaker, etc. Ofcourse, those of ordinary skills in the art should understand that thehead-mounted wearable apparatus is only an example of the presentdisclosure, and other wearable apparatuses such as intelligent watches,intelligent clothes, intelligent accessories, etc. may also be used inembodiments of the present disclosure.

Wherein the above-mentioned image collector 11 is operable to acquireimages of the face and body of the conversation partner who isinteracting with the user of the head-mounted wearable apparatus. Thecontroller 12 is operable to analyze the images of the face and body ofthe conversation partner and get analysis results. The output device 13is operable to output the analysis results. It should be noted that theinteraction with the user of the head-mounted wearable apparatusincludes a variety of other ways of interactions or combinations thereofin addition to conversation. For example, interaction may proceedthrough body language such as gestures, through facial expression, etc.When the user of the head-mounted wearable apparatus is interacting withhis conversation partner through conversation, the above-mentionedanalysis results include analysis results of content and manner of theirconversation. When the interaction between the user of the head-mountedwearable apparatus and his conversation partner takes another way, theabove-mentioned analysis results accordingly include analysis results ofcontent and manner of the interaction. The present embodiment of thedisclosure is described only in the case of the conversation partner whointeracts with the user of the head-mounted wearable apparatus.

The image collector 11 in the present embodiment may be a first camerato acquire images of the face and body of the conversation partner. Forexample, the first camera may be a binocular one, which has a highresolution and can acquire two images of the conversation partner fromdifferent directions/locations so as to capture minor changes in facialimages of the conversation partner for subsequent analysis by thecontroller.

Of course, in other embodiments, the above-mentioned image collector 11may include two or more cameras with angles formed therebetweenhorizontally. It is to be noted that two of them may be spaced apart bya preset distance, can both capture high-resolution images, and cancapture two images of the conversation partner simultaneously from twodifferent angles/directions/locations, so that minor changes in facialimages of the conversation partner can be captured for subsequentanalysis by the controller to achieve accurate results.

The above-mentioned output device 13 may be a display for display ofanalysis results, such as a liquid crystal display. Alternatively, inother embodiments, the output device 13 may be a voice displayer, suchas a microphone, to play back analysis results in voice.

The head-mounted wearable apparatus in the present embodiment canacquire images of the conversation partner by means of a head-mountedimage collector, analyze the images through the controller to determinethe truthfulness/interest of the conversation partner with regard to thecurrent conversation, and output the results through the output device13. Furthermore, the head-mounted wearable apparatus of the presentdisclosure is convenient to carry and of low costs, and can be used morewidely and improve user experiences.

For example, with reference to FIG. 1 b, the head-mounted wearableapparatus further includes a wireless module 14 and/or a GlobalPositioning System (GPS) module 15. The wireless module 14 and the GPSmodule 15 are both connected with the controller 12. The wireless module14 is used to enable the controller to communicate with other networkequipments (e.g. intelligent terminals, etc.), and it may be, forexample, a communication module including a wireless router, an antenna,etc. The controller may send analysis results through the wirelessmodule 14 to an intelligent terminal for display or other purposes.

The GPS module 15 may be used to locate the head-mounted wearableapparatus and provide location information and the like.

By way of example, the above-mentioned head-mounted wearable apparatusmay be intelligent glasses that include a glasses body, and the imagecollector 11, the controller 12 and the output device 13 in the aboveFIG. 1a can all be mounted on the glasses body.

Furthermore, in practical applications, with reference to FIG. 1 b, thehead-mounted wearable apparatus shown in FIG. 1 and described above mayinclude a selecting device 16 that is connected with the controller 12and used to receive a selecting instruction from the user and send it tothe controller 13 which then get analysis results corresponding to theselecting instruction. The selecting device 16 may be keys receivinguser input, a microphone receiving voice commands from the user or thelike.

Furthermore, the selecting device 16 includes a first selecting unit 161to receive an analysis instruction for interest from the user and asecond selecting unit 162 to receive an analysis instruction forcredibility from the user.

By way of example, the selecting device 16 described above may beselection buttons, such as buttons disposed on the glasses body of theintelligent glasses and connected with the controller for the user toselect an analysis aspect. When a button is activated, the controller 12will obtain analysis results in the aspect belonging to the activatedbutton.

Alternatively, buttons operable to enable or disable the intelligentmode are disposed on the glasses body of the intelligent glasses, and ifthe button operable to enable the intelligent mode is selected by theuser, the controller 12 will obtain analysis results in a defaultanalysis aspect. Generally, the default analysis aspect is aboutinterest in the conversation.

For example, when A is conversing with B, the intelligent glassesdescribed above may be worn by A to acquire and analyze images of theface and body of B in real time and output analysis results to A, sothat A can determine whether B is interested in the current conversationor determine the credibility of what B has said.

It is to be noted that when the selecting device 16 receives a selectinginstruction, the controller 12 as shown in FIG. 1b may obtaincorresponding analysis results in accordance with the selectinginstruction. For example, the body image at the current point in time iscompared with that at a first point in time, and if the former is nearerto the user relative to the latter, it can be determined that theconversation partner is interested in the contents of the currentconversation, resulting in an analysis result of behavior.

Wherein the first point in time is prior to the current point in time,and there is a preset interval between the two points.

The controller 12 can also analyze facial images, and obtain analysisresults of heart rate and pupil. For example, the controller analyzesfacial images with contactless pulse oximetry to obtain an analysisresult of heart rate; the controller obtains the pupil area in thefacial image at the current point in time and that in the facial imageat the second point in time, and makes comparison between them to get ananalysis result of pupil.

Wherein the second point in time is prior to the current point in time,and there is a preset interval between the two points.

Furthermore, the controller 12 in the present embodiment may alsoinclude an analyzing module, which is operable to determine an outputresult of the conversation contents given by the conversation partner inaccordance with the analysis results of behavior, heart rate and pupil.

For example, the analyzing module may determine the output result of theconversation contents given by the conversation partner to be positivewhen at least two of the analysis results of behavior, heart rate andpupil are positive.

Alternatively, in accordance with predetermined weighting factors ofindividual analysis results, the analyzing module may determine theoutput result of the conversation contents given by the conversationpartner by multiplying the analysis results with their own weightingfactors and adding the products together.

Alternatively, the analyzing module may obtain the average value of allthe analysis results and take it as the output result of theconversation contents of the conversation partner. It is to be notedthat the positive result, as used herein, may be understood as theresult desired by the user. As such, misjudgments are avoidedeffectively during analysis of the various analysis results. The outputresult of the conversation contents of the conversation partner isdetermined to be positive when at least two of the analysis results ofbehavior, heart rate and pupil are positive. In an example to illustratethis, stable heart rate is analyzed to mean no lying during heart rateanalyzing (a positive result); dilated pupils are analyzed to mean lyingduring pupil analyzing (a negative result); and it is analyzed to meanno lying that the conversation partner is near to the user duringbehavior analyzing (a positive result). As a result, misjudgments can beavoided, which otherwise may be caused by analyzing only facial imagesor body images. Alternatively, misjudgments can be eliminated accordingto difference between the weighting factors of individual analysisresults, which follows a principle similar to that described above, andno further details will be described herein.

The intelligent glasses in the present embodiment may have otherfunctionality, such as taking photographs, navigation, etc. Theintelligent glasses in the present embodiment may be intelligent socialglasses, whose hardware includes a glasses frame (i.e. a glasses body)as well as a binocular camera, a controller/processor, a wirelessmodule, a GPS module, a power module, and the like mounted on theglasses frame.

It can be seen from the above technical solution that in thehead-mounted wearable apparatus and the information processing methodand device thereof in the present disclosure the head-mounted imagecollector acquires images of the conversation partner, and thecontroller analyzes the images to determine truthfulness/interest of theconversation partner with respect to the current conversation andprovides an output result through the output device. Moreover, thehead-mounted wearable apparatus in the present disclosure is convenientto carry and of low costs. Furthermore, only by means of acquiringimages of the conversation partner, the head-mounted wearable apparatuscan determine his variation of heart rate, eyeball movement and changeof pupil so as to get credibility of what he has said or his degree ofinterest in the conversation, so that the apparatus is convenient tooperate, can be applied widely, and improves user experiences.

A second embodiment of the present disclosure will be presented in thefollowing description, which is similar to the first embodiment, but isstill different from it in that the image collector shown in FIG. 1 mayinclude a second camera to acquire body images of the conversationpartner and a receiver to receive facial images of the conversationpartner. For example, the conversation partner may also wear ahead-mounted wearable apparatus, through which the user's own facialimages can be acquired and sent to other user equipments. In this way,the receiver may receive the facial images sent by the conversationpartner.

FIG. 2 shows a structure diagram of a head-mounted wearable apparatusprovided in another embodiment of the present disclosure. As shown inFIG. 2, the head-mounted wearable apparatus includes a second camera 21,a controller 22 (e.g. a CPU or a microprocessor) connected with thesecond camera 21, an output device 23 (e.g. a display or a speaker)connected with the controller 22 and a receiving module 24 (e.g. areceiving antenna or a memory) connected with the controller 22.

The second camera 21 may acquire body images of the conversation partnerinteracting with the user of the head-mounted wearable apparatus and thereceiving module 24 may receive facial images of the conversationpartner, such as those sent by the head-mounted wearable apparatus wornby the conversation partner. The controller 22 is operable to analyzethe facial images and body images of the conversation partner and getanalysis results, and the output device is operable to output theanalysis results. It is to be noted that the head-mounted wearableapparatus is only an example of the present disclosure, and otherwearable apparatuses such as smart watches, intelligent clothes,intelligent accessories, or the like may be used in embodiments of thepresent disclosure. Moreover, the interaction with the user of thehead-mounted wearable apparatus may include a variety of other ways ofinteractions or combinations thereof in addition to conversation. Forexample, the interaction may proceed through body language such asgestures or through facial expression. When the user of the head-mountedwearable apparatus is interacting with a conversation partner throughconversation, the above-mentioned analysis results include analysisresults of conversation content and conversation manner. When the userof the head-mounted wearable apparatus is interacting with hisconversation partner in other ways, the above-mentioned analysis resultsaccordingly include analysis results of the contents and manner of theother ways of interactions. The present embodiment of the disclosure isdescribed only in the case of the conversation partner who interactswith the user of the head-mounted wearable apparatus.

It is to be noted that what the receiving module 24 can receive in thepresent embodiment is facial images of the conversation partner sent bythe head-mounted wearable apparatus worn by him. In other embodiments,the receiving module 24 may also receive facial images of theconversation partner from any intelligent apparatus as long as theintelligent apparatus can acquire and send facial images of theconversation partner in real time.

Furthermore, the second camera in the present embodiment is preferably abinocular camera, which has a relatively high resolution and can acquiretwo body images of the conversation partner from differentdirections/locations for subsequent analysis by the controller.

Optionally, the head-mounted wearable apparatus of the presentembodiment may further include an image collector such as the thirdcamera 25 shown in FIG. 2 and a transmitting module 26 (e.g. atransmitter), both of which are connected with the controller.

The image collector, i.e. the corresponding third camera 25, may be usedto acquire facial images of the user of the head-mounted wearableapparatus and the transmitting module 26 may transmit the facial imagesof the user to the head-mounted wearable apparatus worn by theconversation partner.

That is to say, when two parties are conversing, they may each use theirown head-mounted wearable apparatuses as shown in FIG. 2 to determinethe value of interest (e.g. an interest index) of the other party in thecurrent conversation contents, the credibility of what the other partyhas said, or other information.

For example, when A and B are conversing and both wear head-mountedwearable apparatuses as shown FIG. 2, the head-mounted wearableapparatus a worn by A acquires body images of B and facial images of A,and the head-mounted wearable apparatus b worn by B acquires facialimages of B and body images of A; then the head-mounted wearableapparatus a worn by A receives the facial images of B sent by thehead-mounted wearable apparatus b worn by B and analyzes the facialimages and body images of B so as to get a result indicating whether Bis interested in the current conversation or get the credibility of whatB has just said or other information.

In practical applications, the head-mounted wearable apparatus as shownin FIG. 2 may be intelligent glasses. As shown in FIG. 5, whenconversing, both of the two parties of the interaction wear intelligentglasses respectively to learn about the interest of the other party inthe current conversation contents and the credibility of what the otherparty has said. The intelligent glasses further include a glasses body,and the above-mentioned second camera 21, image collector, controller22, output device 23, sending module 26 and receiving module 24 are alllocated on the glasses body.

Of course, the head-mounted wearable apparatus shown in FIG. 2 mayfurther include a selecting device connected with the controller 22,which is the same as the one in FIG. 1b and used to receive selectinginstructions from the user for the controller to get analysis resultscorresponding to the selecting instructions.

By way of example, the above-mentioned selecting device may be selectionbuttons connected with the controller 22, such as the buttons disposedon the glasses body for the user to select an analysis aspect.

Wherein when a button is activated by the user, the controller will getanalysis results in the analysis aspect belonging to the activatedbutton.

Of course, buttons operable to enable or disable the intelligent modemay further be disposed on the glasses body, and if the user selects toactivate the button operable to enable the intelligent mode, thecontroller will get analysis results in the default analysis aspect.

The intelligent glasses in the present embodiment can performqualitative analysis on the conversation contents of the conversationpartner, and the intelligent glasses have compact configuration, areconvenient to carry and of low costs, can be applied widely, and haveuser experiences improved.

FIG. 3 shows a flowchart of an information processing method for ahead-mounted wearable apparatus in one embodiment of the presentdisclosure. As shown in FIG. 3, the head-mounted wearable apparatus inthe present embodiment operates as follows.

In step 301, image information of the conversation partner is acquired,which includes facial images and body images of the conversationpartner.

For example, if the head-mounted wearable apparatus shown in FIG. 1 isused by a user, in step 301 image information of the conversationpartner will be acquired in real time with the image collector such as abinocular camera.

If the head-mounted wearable apparatus shown in FIG. 2 is used by auser, in step 301 body images of the conversation partner will beacquired in real time with the first image collector, and facial imagesof the conversation partner, such as those sent by the head-mountedwearable apparatus worn by the conversation partner will be received bythe receiving module.

In step 302, the body images are analyzed to get an analysis result ofbehavior and the facial images are analyzed to get analysis results ofheart rate and pupil.

When the method shown in FIG. 3 uses the head-mounted wearable apparatusshown in FIG. 1 or FIG. 2, step 302 and the following step 303 may beperformed through the controller of the head-mounted wearable apparatus.By way of example, the controller may get an analysis result of heartrate through contactless pulse oximetry.

In the present embodiment, the analysis aspect of interest is selectedby the user and thus the analysis results of behavior, heart rate andpupil are respectively analysis results of behavior, heart rate andpupil indicating whether there is interest in the conversation contents.

If the analysis aspect of credibility is selected, the analysis resultsof behavior, heart rate and pupil will respectively be analysis resultsof behavior, heart rate and pupil indicating credibility rate of theconversation contents.

In step 303, an output result of the conversation contents of theconversation partner is determined in accordance with the analysisresults of behavior, heart rate and pupil.

In step 304, the output result of conversation contents is output to theuser of the head-mounted wearable apparatus.

When the method shown in FIG. 3 uses the head-mounted wearable apparatusshown in FIG. 1 or FIG. 2, step 304 may be performed by the outputdevice of the head-mounted wearable apparatus.

Generally, when a person is lying, significant changes will occur in hisgestures, use of words or other aspects, and therefore the eyeball areaand the pupil area in the facial images may be analyzed in theabove-mentioned embodiment to get an analysis result.

The head-mounted wearable apparatus in the present embodiment may be theabove-mentioned intelligent glasses, which can determine analysisresults of variation of heart rate, eyeball movement and change of pupilby acquiring image information of the conversation partner so as to getthe credibility of what the conversation partner has said or the degreeof interest of the conversation partner in the conversation.

FIG. 4 shows a flowchart of an information processing method forintelligent glasses in one embodiment of the present disclosure. Theinformation processing method for intelligent glasses in the presentembodiment is as follows. It should be noted that the intelligentglasses in the present embodiment may be the head-mounted wearableapparatus shown in FIG. 1 or FIG. 2.

In step 401, the selecting device of the intelligent glasses receives aselecting instruction.

Of course, in practical applications, the selecting instruction may bean analyzing instruction for interest or credibility. Furthermore, inother embodiments, the selecting device may be a receiving unit, themodule/unit receiving selecting instructions is not limited in terms ofname, as long as it has the functionality of receiving selectinginstructions.

In step 402, the image collector of the intelligent glasses acquiresimage information of the conversation partner, which includes bodyimages and facial images of the conversation partner.

That is to say, when the intelligent glasses are worn by a user and abutton for social function is activated (a button as illustrated above),more than two cameras will take facial images and body images of theconversation partner automatically.

In step 403, the controller of the intelligent glasses analyzes the bodyimages to get an analysis result of behavior.

By way of example, step 403 may include the following sub-steps.

In sub-step 4031, the controller of the intelligent glasses compares thebody image at the current point in time with that at a first point intime.

In sub-step 4032, if the body image at the current point in time isnearer to the user relative to that at the first point in time, it canbe determined that the conversation partner is interested in thecontents of the current conversation, resulting in an analysis result ofbehavior.

Wherein the first point in time is prior to the current point in time,and there is a preset interval between the two points.

In step 404, the controller of the intelligent glasses analyzes thefacial images to achieve analysis results of heart rate and pupil.

By way of example, step 404 may include the following sub-steps.

In sub-step 4041, the controller of the intelligent glasses analyzes thefacial images using contactless pulse oximetry to achieve an analysisresult of heart rate.

That is to say, variation value of heart rate and in turn variationcurve of heart rate of the conversation partner are achieved throughcontactless pulse oximetry. For example, if it is above a set threshold,the credibility of what the conversation partner has said is low.Generally, when a common person is lying, his heart rate will varysignificantly.

In sub-step 4042, the controller of the intelligent glasses obtains thepupil area in the facial image at the current point in time and thepupil area in the facial image at the second point in time.

In sub-step 4043, the controller of the intelligent glasses compares thepupil area at the current point in time with that at the second point intime to get an analysis result of pupil.

Wherein the second point in time is prior to the current point in time,and there is a preset interval between the two points.

Generally, most people have their eyeballs move toward upper right whenthey are lying, and move toward upper left when they are trying toremember something that really happened. Therefore, it can be determinedwhether the conversation partner is lying in accordance with thedirection of eyeball movement in the pupil area of his facial images.

In addition, when a person is caught in a repulsive, irritating orprovoking topic, his pupil will contract involuntarily. On the contrary,when a person is involved in a pleasant topic, his pupil will dilateinvoluntarily, and if a person feels panic, cheerful, fond of somethingor excited, his pupil may dilate 4 or more times.

In step 405, the controller of the intelligent glasses determines anoutput result of the conversation contents of the conversation partnerin accordance with the analysis results of behavior, heart rate andpupil.

By way of example, if at least two of the analysis results of behavior,heart rate and pupil are positive, the controller of the intelligentglasses may determine the output result of the conversation contents ofthe conversation partner to be positive. The positive result, as usedherein, may be understood as the result desired by the user.

That is to say, if the selecting instruction is one for interest, andthe analysis result of heart rate indicates interest, the analysisresult of pupil indicates interest and the analysis result of behaviorindicates no interest, the output result will be one indicatinginterest.

Alternatively, if the selecting instruction is an analysis instructionfor credibility, and the analysis result of behavior indicates lowcredibility, the analysis result of heart rate indicates low credibilityand the analysis result of pupil indicates high credibility, the outputresult will be one indicating low credibility.

In another possible implementation, in accordance with predeterminedweighting factors of individual analysis results, the controller of theintelligent glasses may multiply the analysis results with their ownweighting factors and add the products together to get the output resultof the conversation contents given by the conversation partner.

In a third possible implementation, the controller of the intelligentglasses may calculate the average value of all the analysis results andtake it as the output result of the conversation contents of theconversation partner.

In step 406, the output device of the intelligent glasses outputs theoutput result of the conversation contents to the user of theintelligent glasses.

By acquiring image information of the conversation partner, theintelligent glasses in the present embodiment may also determinevariation of heart rate, eyeball movement and change of pupil of theconversation partner and in turn the credibility of what theconversation partner has said and the degree of interest of theconversation partner in the conversation. The intelligent glasses in thepresent embodiment of the disclosure are convenient to operate, of lowcosts, and make user experiences well improved.

To better illustrate embodiments of the present disclosure, the methodof analyzing the facial images through contactless pulse oximetry by thecontroller of the intelligent glasses to get an analysis result of heartrate in sub-step 4041 will be described in details as follows.

At present, contactless pulse oximetry of SpO2 photographic technologymay detect human heart rate using a common optical camera, wherein, forexample, a video including facial images of a person is taken and thesame analysis area (e.g. the area in the dashed line box) is determinedfrom each image of the video.

An average value of the pixels in G (green) and B (Blue) channels isextracted for the analyzed area in each image of the video, wherein theG channel is a green channel, and the B channel is a blue channel.

And the variation curve of heart rate of the person can be achievedaccording to the variation curve over time of the average value of thepixels in G channels and the variation curve over time of the averagevalue of the pixels in B channels in the analysis areas of all theimages of the video.

The head-mounted wearable apparatus in the present embodiment can findapplication in a variety of scenes such as a lie detecting scene, ablind date scene, a question and answer scene, etc.

In the third aspect of the present embodiment of the disclosure, aninformation processing device for a head-mounted wearable apparatus isfurther provided. As shown in FIG. 7, the information processing devicefor a head-mounted wearable apparatus in the present embodiment includesan acquiring unit 71, a processing unit 72, an analyzing unit 73 and anoutput unit 74.

The acquiring unit 71 is operable to acquire image information of theconversation partner including facial images and body images of theconversation partner.

The processing unit 72 is operable to analyze the body images to achievean analysis result of behavior and analyze the facial images to achieveanalysis results of heart rate and pupil.

The analyzing unit 73 is operable to determine an output result of theconversation contents of the conversation partner in accordance with theanalysis results of behavior, heart rate and pupil.

The output device 74 is operable to output the output result of theconversation contents to the user of the head-mounted wearableapparatus.

By way of example, the above-mentioned analyzing the body images toachieve an analysis result of behavior by the processing unit 72 will bedescribed as follows.

The body image at the current point in time is compared with that at thefirst point in time.

If the body image at the current point in time is nearer to the userrelative to that at the first point in time, it can be determined thatthe conversation partner is interested in the contents of the currentconversation, resulting in an analysis result of behavior.

Wherein the first point in time is prior to the current point in time,and there is a preset interval between the two points.

Furthermore, the above mentioned analyzing the facial images to achieveanalysis results of heart rate and pupil by the processing unit 72 willbe described as follows.

The facial images are analyzed using contactless pulse oximetry toachieve an analysis result of heart rate.

The pupil area in the facial image at the current point in time and thepupil area in the facial image at the second point in time are obtained.

The pupil area at the current point in time is compared with that at thesecond point in time to achieve an analysis result of pupil.

Wherein the second point in time is prior to the current point in time,and there is a preset interval between the two points.

Furthermore, the above-mentioned analyzing unit 73 is operable todetermine the output result of the conversation contents of theconversation partner to be positive when at least two of the analysisresults of behavior, heart rate and pupil are positive.

Alternatively, in accordance with predetermined weighting factors ofindividual analysis results, an output result of the conversationcontents of the conversation partner may be obtained by multiplying theanalysis results with their own weighting factors and adding theproducts together.

Alternatively, an average value of all the analysis results is obtainedand taken as the output result of the conversation contents of theconversation partner.

Moreover, in an optional implementation scene, the informationprocessing device for a head-mounted wearable apparatus described abovemay include a receiving unit not shown in the figure, which will bedescribed in the following.

The receiving unit is operable to receive a selecting instruction fromthe user before the body images and the facial images are analyzed bythe processing unit 72.

Accordingly, the analysis results of behavior, heart rate and pupil fromthe processing unit 72 are respectively analysis results of behavior,heart rate and pupil indicating whether there is interest in theconversation contents.

In another optional implementation scene, the receiving unit is operableto receive an analysis instruction for credibility before the bodyimages and the facial images are analyzed by the processing unit 72.

Accordingly, the analysis results of behavior, heart rate and pupil fromthe processing unit 72 are respectively analysis results of behavior,heart rate and pupil indicating the credibility rate of the conversationcontents.

In an implementation process, the information processing device for ahead-mounted wearable apparatus in the present embodiment may beimplemented through software, which may be integrated into a physicalstructure of the head-mounted wearable apparatus to execute the processdescribed above. Of course, in combination with the configurations ofthe head-mounted wearable apparatuses shown in FIG. 1 and FIG. 2, theinformation processing device in the present embodiment may also beimplemented through physical circuit structures, which constitutes nolimitation on the present embodiment and depends on specificcircumstances.

In the present embodiment, by acquiring image information of theconversation partner, variation of heart rate, eyeball movement andchange of pupil of the conversation partner and in turn the credibilityof what the conversation partner has said and the degree of interest ofthe conversation partner in the conversation can be determined. Theinformation processing device for a head-mounted wearable apparatus inthe present embodiment of the disclosure is convenient to operate, oflow costs and makes user experiences well improved.

Those skilled in the art can make various modifications and variationsto the present disclosure without departing from the spirit and scopethereof. Thus, if these modifications and variations of the presentdisclosure are within the scope of the claims of the disclosure as wellas their equivalents, the present disclosure is also intended to includethese modifications and variations.

The present application claims priority of China patent application No.201510609800.8 filed on Sep. 22, 2015, the disclosure of which isincorporated herein in its entirety by reference as a part of thepresent application.

1. A wearable apparatus comprising: an image collector configured toacquire facial images and body images of an interaction partner who isinteracting with the user of the apparatus; a controller connected withthe image collector and configured to analyze the facial images and thebody images to achieve analysis results; and an output device connectedwith the controller and configured to output the analysis results. 2.The apparatus of claim 1, wherein the image collector is a first camerato acquire facial images and body images of the interaction partner; orthe image collector comprises a second camera to acquire body images ofthe interaction partner and a receiver to receive facial images of theinteraction partner.
 3. The apparatus of claim 1, wherein the firstcamera and/or the second camera are/is binocular camera(s).
 4. Theapparatus of claim 1, wherein the output device is a display screen fordisplay of analysis results; or the output device is a voice displayerfor playback of analysis results in voice.
 5. The apparatus of claim 1,wherein the wearable apparatus is intelligent glasses.
 6. The apparatusof claim 5, wherein the intelligent glasses further comprise a glassesbody and the image collector, controller and output device are alldisposed on the glasses body.
 7. The apparatus of claim 1, wherein theanalysis results comprise an analysis result of behavior obtainedthrough analyzing the body images as well as an analysis result of heartrate and an analysis result of pupil obtained by analyzing the facialimages.
 8. The apparatus of claim 1, wherein the wearable apparatusfurther comprises a selecting device, which is connected with thecontroller and configured to receive a selecting instruction from theuser and send it to the controller so that the controller may obtainanalysis results corresponding to the selecting instruction.
 9. Theapparatus of claim 8, wherein the selecting device comprises a firstselecting unit to receive an analysis instruction for interest from theuser and a second selecting unit to receive an analysis instruction forcredibility from the user.
 10. The apparatus of claim 1, wherein thewearable apparatus further comprises: a wireless module connected withthe controller and operable to communicate with network equipmentsthrough a wireless network; and/or a GPS module connected with thecontroller and operable to locate the wearable apparatus; and/or animage collector connected with the controller and operable to acquirefacial images of the user of the wearable apparatus and a transmitterconnected with the controller and operable to transmit the imagesacquired by the image collector.
 11. The apparatus of claim 1, whereinthe wearable apparatus comprises a head-mounted wearable apparatus. 12.The apparatus of claim 1, wherein the interaction partner comprises aconversation partner.
 13. An information processing method for awearable apparatus, comprising: acquiring image information of theinteraction partner who is interacting with the user of the wearableapparatus, the information comprising facial images and body images ofthe interaction partner; analyzing the body images to achieve ananalysis result of behavior and analyzing the facial images to achievean analysis result of heart rate and an analysis result of pupil;determining an output result of the conversation contents given by theinteraction partner in accordance with the analysis result of behavior,analysis result of heart rate and analysis result of pupil; andoutputting the output result of the conversation contents to the user ofthe wearable apparatus.
 14. The method of claim 13, wherein, before thebody images are analyzed, the method further comprises the step ofreceiving a selecting instruction; if the received selecting instructionis an analysis instruction for interest, the analysis results ofbehavior, heart rate and pupil are respectively analysis results ofbehavior, heart rate and pupil indicating whether there is interest inthe interaction contents; and if the received selecting instruction isan analysis instruction for credibility, the analysis results ofbehavior, heart rate and pupil are respectively analysis results ofbehavior, heart rate and pupil indicating the credibility rate of theinteraction contents.
 15. The method of claim 13, wherein the step ofanalyzing the body images to achieve an analysis result of behaviorcomprises: comparing the body image at the current point in time withthe body image at the first point in time; and determining an analysisresult of behavior indicating that the conversation partner isinterested in the current interaction contents if the body image at thecurrent point in time is nearer to the user relative to the body imageat the first point in time; wherein the first point in time is prior tothe current point in time, and there is a preset interval between thetwo points.
 16. The method of claim 13, wherein the step of analyzingthe facial images to achieve analysis results of heart rate and pupilcomprises: analyzing the facial images using contactless pulse oximetryto achieve the analysis result of heart rate; obtaining the pupil areain the facial image at the current point in time and the pupil area inthe facial image at the second point in time; and comparing the pupilarea at the current point in time with the pupil area at the secondpoint in time to achieve the analysis result of pupil; wherein thesecond point in time is prior to the current point in time, and there isa preset interval between the two points.
 17. The method of claim 13,wherein the step of determining an output result of the interactioncontents given by the interaction partner in accordance with theanalysis result of behavior, analysis result of heart rate and analysisresult of pupil comprises: determining the output result of theinteraction contents of the interaction partner to be positive when atleast two of the analysis result of behavior, analysis result of heartrate and analysis result of pupil are positive; or in accordance withpredetermined weighting factors of individual analysis results,obtaining the output result of the interaction contents of theinteraction partner by multiplying the analysis results with their ownweighting factors and adding the products together; or obtaining theaverage value of all the analysis results and taking it as the outputresult of the interaction contents of the interaction partner.
 18. Themethod of claim 13, wherein the wearable apparatus comprises ahead-mounted wearable apparatus.
 19. The method of claim 13, wherein theinteraction partner comprises a conversation partner.
 20. An informationprocessing device for a wearable apparatus, the device comprising: anacquiring unit configured to acquire image information of theinteraction partner who is interacting with the user of the wearableapparatus, the information comprising facial images and body images ofthe interaction partner; a processing unit configured to analyze thebody images to achieve an analysis result of behavior and analyze thefacial images to achieve analysis results of heart rate and pupil; ananalyzing unit configured to determine an output result of theinteraction contents given by the interaction partner in accordance withthe analysis result of behavior, analysis result of heart rate andanalysis result of pupil; and an output unit configured to output theoutput result of the interaction contents to the user of the wearableapparatus.
 21. (canceled)
 22. (canceled)
 23. (canceled)
 24. (canceled)25. (canceled)
 26. (canceled)